Is the Top Quark Really Heavier than the W Boson? 
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Scalar induced top decays may drastically suppress B{t ^ + jet) and still hide the top below 
Mw- The pp collider experiments should enlarge the scope and study the mt — B{t Ei/j) plane. 
Specific model signatures such as t ^ chP ebb (multiple high pr &-jets) and t bH^ bcs, br^v 
(with B{t brv) ^ 1/3) should be explored. Without ruling out these possibilities, isolated lepton 
signals in the future might actually be due to the 4th generation t' or b' quark, while top quark and 
CO ' toponium physics could still turn up at LEP-II. 

^ . PACS numbers: 14.80.Dq, 14.80. Gt, 12.15.Cc, 13.90.+i 

o 

\ When the r-lepton and the 6-quark ^ were dis- 
(-^ : covered in the 1970's, the top quark was thought to be 
just around the corner, with mass of order 10 — 30 GeV. 
' Shortly after the ARGUS observation of large B°-B° 
mixing however, the prejudice started to shift. To 
date, the top remains elusive. A global fit Q to LEP 
and low energy electroweak data suggests a high value of 



> 

o 

^ ! mt = 150+26 =^ 

T— I The published direct search limit by the CDF CoUabo- 

' ration is S 

o\ ■ 

^ ! mt > 91 GeV, (2) 

I ■ based on data collected in the 1989 Tevatron collider run 
Oh, at Fermilab. With an order of magnitude more data from 
2h ' the 1993 collider run, the CDF and DO collaborations 
have extended the Hmit to about 120 GeV Though 
K>" ■ not yet conclusive, a handful of events hint at a top mass 
k>( ' consistent with the global fit result of eq. (0). Thus, 
. once again we have the expectation that the top is "just 
d around the corner" , and should be discovered in the 1994 
Tevatron collider run. 

So, the top seems to be very heavy. But what hard 
evidence do we really have? Eq. (|l|) assumes the 3 gen- 
eration Standard Model (SM). If the top is in fact rela- 
tively light, it actually suggests the existence of new weak 
doublets (or other multiplcts) with sizable splittings. Eq. 
(^ assumes the SM branching ratio 

B,,i,=B{t^e+,y + X)^^. (3) 

The limit would weaken if Bs.i. is far below this value. 
A weaker limit of mt > 55 GeV is obtained from 
the measured W width. This limit would soften if the 
quark mixing element \Vtb\ < 1. The truly model inde- 
pendent limit comes from Z search Q at LEP/SLC, 
mt ^ Mz/'i. Thus, a relatively light top should not be a 
forgone conclusion. 
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The mass region that needs special scrutiny is 



Mz/2 <,mt <, Mw + rub. (4) 

The reason is as follows. For rat > Mw + rrib, F(i bW) 
is rather large, and eq. (||) should hold. However, below 
the W threshold, t — > hW* is suppressed both by phase 
space (three body) and propagator effects. If new inter- 
actions induce two body decays, they would be relatively 
enhanced, thereby suppressing Bs.i.- The new coupling 
strength should not be much weaker than SUl{2) gauge 
coupling, and the modes should be relatively obscure 
such that they have not yet been studied. Effectively 
this can be achieved only by (pseudo) scalar interactions 
(including sfermions). Possible scenarios are: t —^ ebb 
where bb comes from the decay of a light neutral scalar 
boson or t bcs, where cs comes from a charged 

Higgs boson A third possibility oft ^ bH^ — > &t+i/ 
[ pl| is unlikely_||l2| in light of recent limits on 6 ^ 57 
from CLEO The two scenarios lead to t ^ 3 jets 

final state, which is very hard to disentangle in hadronic 
collisions. We suggest that the newly accumulated data 
should be used to explore the low mt possibility of eq. 
(^, by taking Bg.i. as a free parameter. We then com- 
ment on means of detecting the specific, new modes, as 
well as implications of having a light top quark. 

The semileptonic decays, except perhaps t br^v, 
are expected to be mediated by the W boson. Eq. (||) 
assumes r^^{t 3 jets) ~ 6T{t e+z^-f jet). However, 
some new interaction could enhance the t ~* jets mode, 
that is Faj = Ff^*^ -I- Fg^- , where Fg^- is the additional 3-jet 
width. Eq. (||) gets modified by the factor 

R^Bs.i./B^f = il-B'), (5) 

where B' = T' / {T^^^ + F') is the new physics branching 
ratio. It could be other new top decay possibilities, e.g. 
light supersymmetric (SUSY) particles 
The search mode branching ratios become 

l^il-B')\l-^il-B'){l^\B')^ (6) 

for tt — !■ (-il2 + + jets and + u + jets, respectively. 
It is clear that if B' ~ 1 (or Bs.i. 0), the dilepton 
signature and therefore the limit of eq. (|^) would rapidly 
become ineffective. The weaker limit of mt < 77 GeV 
(assuming SM) obtained from i'^ + v + jets search, 
is less sensitive to B' . 

To explore the possibility of B' ~ 1 (i? ^ 0), one 
should keep B{t i^i' + X) as a free parameter. One 
has to purposely keep the cuts on lepton px and missing 
Et relatively low, otherwise the signal events might get 
rejected by stiffer cuts aimed at searching for a heavier 
top quark. Furthermore, as the expected number of sig- 
nal events dwindle, a more careful study is needed to sup- 
press background to a level below what has been achieved 
in the analysis of 1989 data. To the best of our knowl- 
edge, this has not yet been done by the experimental 
collaborations Ml. 
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Let us take theoretical tt cross sections and use eq. (^) 
to scale the mt limits from 1989 CDF data as function 
of R. The results are given in Fig. 1, where we have as- 
sumed constant efhciencies and acceptance. Clearly, for 
smaller Bs.i., only the experimental groups can give def- 
inite curves, but they should in general fall below those 
shown in Fig. 1. Newer data from 1993 and later runs can 
be used to extend the excluded domain in the mt — Bs.i. 
plane. Note that for smaller i?, the single lepton sig- 
nal is more effective. However, both methods fail in the 
vicinity of R = 0, since the signal would vanish against 
background. 

We turn to specific models that may allow nit to fall in 
the range of eq . (Q) . The first mode is t ch'^ followed 
by h^ bb , within the context of two Higgs doublet 
models (2HDM). At first sight this seems absurd, since 
in standard types of 2HDM, just like in SM, tree level 
FCNC Higgs couplings are absent by construction [ pT| . 
However, this turned out to be an overkill. Neu- 
tral Higgs bosons can have flavor changing neutral cou- 
plings (FCNC) Xij of order ^2mimj/v, and with nor- 
mal Higgs boson masses of order the vacuum expectation 
value V. The t-c-h^ coupling Ate is precisely the largest 
It is furthermore possible that only u-type quarks 
have FCNC couplings, while neutral Higgs couplings to 
d-type quarks and charged leptons are diagonal as in SM 
and standard 2HDM. In this variant stringent limits 
from ji ^ ej ||l9| ] and K^~K^ mixing, etc., are evaded, 
while limits from D^-D'^ mixing are rather forgiving, so 
TO/jO and/or Ajc are practically unconstrained. We re- 
mark that, within the context of general 2HDM, neutral 
Higgs boson mass limits from LEP Q are weakened, and 
771^0 < Mz/'i is still allowed. 

We assume h^^ — s- bb with approximately SM width and 
explore 



m/jO < TOt — 10 GeV, Act > \/2mcm^/w, (7) 

The t ebb final state is purely hadronic, and 

is very suppressed in SM. For both scalar and pseu- 
doscalar for the range of eq. (0), F' = r(t ch'^) 
^ {XlJ?,2TT)mt{l - mla/mlf > 0.049 mcm^/lGTrw^. 
Together with Ff^f = r{t bW*), B' and Bs.i. can 
be readily estimated from eq. Note that B' = 1 — R 
is the t ch^ branching ratio. We plot mt vs. R in Fig. 
2 for various parameters satisfying eq. (j^). Compared 
with Fig. 1, it is clear that a large parameter range is 
allowed, especially for light m^jO and large Act. 

The second mode \s t ^ bH^ followed by cs 



JlOl . We remark that recent data 1 13 1 on 6 ^ 57 and B 
if *7 are in good agreement with SM expectations, which 
implies [||| that mjj+ > mt in SUSY type of 2HDM. This 
rules out the possibility of B{t br'^v) 1. However, 
in non-SUSY type of 2HDM, where t-b-H^ coupling is of 

the form Vtb cot (3 t{mtL — mtR) b-\-h.c., one obtains 
the rough limit tan /3 <; 0.5 for light ||l^ . (Note that 
one could also have charged Higgs bosons from "nonstan- 
dard" 2HDM's that possess FCNC Higgs couplings.) We 
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plot rrit vs. R in Fig. 3 for various parameters satisfy- 
ing 41 GeV < < wt - 10 GeV and tan/3 > 0.5. 
Note that since _ff + couplings share a common cot (3, the 
relative rate for cs vs. t~^u is roughly 3m^ : m^. 

As noted earlier, 1 — i? is the yet unobserved t ch^ 
or t hH^ branching ratio. As i? ^ 0, so B' ^ 1, 
one should look for direct observables from these decay 
modes. For t ebb, both b jets should be harder than 
the single &-jet from t bW* decay. This is because the 
virtual W tends to be as close to mass shell as possible. 
Hence, one possible way to identify t —> chP — > ebb in case 
it predominates is to tag for (relatively) high pT multiple 
&-jets ||2^]. For the t bH^ mode, clearly t bes would 
be difficult to disentangle from multijet background, un- 
less b tagging plus charm tagging can work together 
rather well. The better hope is to utilize the t br'^v 
mode, which accounts for 1/3 — 1/4 of t ^ bH^ transi- 
tions in non-SUSY type of 2HDM's. Thus, CDF and 
DO should continue the t — > — + br^v search of 
UA1/UA2 |jll[] for the mass region of eq. (Q), but al- 
lowing B{t brv) <, 1/3. 

Some discussion is in order. First, in the range 
of eq. is more "normal" since mt/mi, ~ rric/ms. 

However, the global fit of eq. (1) now implies 
™? +E,(c»/3)Ato2 ^ (■;^94 GeV)^ where c, = 1(3) for 
color singlets (triplets), and Am| > (mi — m2)^ is the 
splitting in new weak doublets. If Amf comes solely from 
the extra Higgs doublet, \mH+ — to/io| should be of or- 
der 300 GeV. It may be more plausible to have a fourth 
generation with \mt' — mb' \ ^ 150 GeV. A heavy, fourth 
generation is favored from the point of view of dynamical 
symmetry breaking [2l| ]. The new neutral heavy lepton, 
however, has to be heavier than Mz/2 to satisfy neutrino 
counting in Z decay Q , which is itself an interesting sit- 
uation. Although the b' quark may also be obscured by 
scalar induced decay (or loop-induced FCNC decay ) , 
t' decay should be dominated by t' — > {b, b') + W, where 
W is on-shell {B{t' th°) should be less than 1/2). 
Thus, even if a "top" -like signal (isolated missing 
Et ) is discovered at the Tevatron, it may well he due to 
t' (or b' ) rather than t, and much work would be needed 
to clarify the actual flavor involved! 

Second, working along the lines sketched in Fig. 1, 
with diligence and luck a "light top" may surface at the 
Tevatron. If not, it is reassuring that the mass range of 
eq. (^ can be fully covered by LEP-II as it turns on in 
1997. It would be amusing that not only we would see 
the crossing of e~^e~ tt (and perhaps b'b') new flavor 
threshold, we would actually be able to study toponium 
physics at LEP-II afterall. The toponium width would 
be dominated by single top (scalar induced) decay, but 
the spectrum would be retained, with rich phenomenol- 
ogy [23|. Third, with extra Higgs doublets and (most 
likely) new fermion generations, B^-B^ mixing can eas- 
ily be accommodated. Furthermore, B^-Bs mixing is no 
longer necessarily close to maximal. All considerations 
regarding CP violation in B sector are enriched, e.g. the 
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unitarity triangle no longer closes. 

In summary, new physics due to light scalar parti- 
cles that preferentially couple to the top, but decay into 
rather elusive final states, could suppress B{t — + £j/ + j) 
and thus allow for rrit < Mw+mb, evading the Tevatron 
bound. The experiments should therefore explore the 
mt — Bs.i. plane. In addition, the process t ch^ ebb 
may be searched for by tagging multiple high px 5-jets, 
while t bH^ bcs, t^v can be studied by searching 
for brv, but assuming B{t ^ brv) ^1/3. The standard 
electroweak fit result of mj ~ 150 GeV would imply large 
splittings in other weak doublets, such as a 4th genera- 
tion. Hence, it may be the t' quark that gets discovered 
at Tevatron in 1994. If toj > Mw cannot be demon- 
strated at the Tevatron beyond doubt, the top may show 
up at LEP-II. If the scenario is realized, there would be 
very rich phenomena unfolding in the near future. After 
being elusive for 15 years, the top quark may surprise us 
once again. 
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FlB.^?^^ -Schematic limit of m* vs. R = Bs.i./Bff for 

dilepton (+) and single lepton (*) signals, scaled from 1989 

CDF^data. The region below, the curve is ruled out, , , 
FIG. 2. EfTcct 8f t ch" mode. The dotted, dashed 

and solid curves are for rUf^o = mt — 10, 20, 30 GeV, 
respectively, while each set (from below) corresponds to 
Ac^^2mcg|^^- 1^^ ,^ 4^ ^^^^ dotted, dashed 

and solid curves are for 41 GeV < mu+ — mt — 10, 20, 30 
GeV, respectively, while each set (from below) corresponds to 
cot/3 = 0.5, 1, 2. 
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